To frustrate, infuriate, irritate or disturb someone.
Please stop reading the name of every sign we came across; it's doing my head in!